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Abstract — In this paper, a new class of circulant matrices 
built from deterministic sequences is proposed for convolution- 
based compressed sensing (CS). In contrast to random con- 
volution, the coefficients of the underlying filter are given by 
the discrete Fourier transform of a deterministic sequence with 
good autocorrelation. Both uniform recovery and non-uniform 
recovery of sparse signals are investigated, based on the coherence 
parameter of the proposed sensing matrices. Many examples of 
the sequences are investigated, particularly the Frank-Zadoff- 
Chu (FZC) sequence, the m-sequence and the Golay sequence. 
A salient feature of the proposed sensing matrices is that they 
can not only handle sparse signals in the time domain, but also 
those in the frequency and/or or discrete-cosine transform (DCT) 
domain. 

Index Terms — Compressed sensing, Frank-Zadoff-Chu se- 
quence, Golay sequence, nearly perfect sequences, random con- 
volution. 



I. Introduction 

COMPRESSED sensing (CS) is a growing theory in signal 
processing aiming at efficient sampling of signals Q], 
0. Consider a length- N signal x and suppose that the basis 
\I> provides a if -sparse representation of x. That is, x = \&f, 
where f can be approximated using only K <C N non-zero 
entries and \& is referred to as the sparsifying transform. 
Throughout this paper, we assume that \& is an N x N 
normalized unitary matrix satisfying M/* SI/ = Ijy. The data 
acquisition process in CS can be described as 



3>x 



(1) 



where y represents an M x 1 sampled vector, <& is an M x N 
measurement/sensing matrix and e is a noise vector. It was 
shown in HI, (2) that if <fr is a Gaussian or Bernoulli random 
operator, x can be faithfully recovered from y using nonlinear 
optimization provided that M > 0{K\og(N / K)). 

Although Gaussian or Bernoulli operators offer optimal 
theoretical bounds, they require huge memory for storage and 
high computational cost for signal reconstruction. Besides, 
fully random matrices are often difficult or expensive in 
hardware implementation. Taking these issues into account, 
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many researchers have investigated structured CS operators 
|3|-| 10 1 . Among them, one class of fast CS sampling operators 
is realized by convolving the signal of interest with a random 
filter and then subsampling 0, 0, H, 0, fld]. They 
hold great potential in applications such as sparse channel 
estimation [4], Fourier optics [8 1, Radar imaging 0, ifTTI and 
coded aperture imaging [12]. 

Note that for convolution-based CS, most existing works 
focus on filters with independent and identically distributed 
(i.i.d.) random coefficients. In this paper, we propose a new 
framework by convolution with a deterministic filter followed 
by random sampling of the outputs. The filter is constructed 
from a sequence with good autocorrelation property, such that 
its energy is spread out in the time domain and uniformly 
distributed across the (discrete) spectrum. A deterministic filter 
is more convenient to implement than a random one. Besides, 
deterministic sequences with good correlation properties have 
found wide applications in Radar, communications and imag- 
ing. By demonstrating that these sequences can be used under 
the convolutional CS framework, it may lead to more efficient 
hardware/software design in above mentioned applications. In 
particular, we show that the proposed scheme can efficiently 
sample a sparse signal in the time/spatial ('J/ = Ijy) or 
spectral (\I> = -L=IFFT) domain. Specifically, for all K- 
sparse signals of length N in the time or spectral domain, 
robust reconstruction can be achieved when the number of 
measurements satisfies M > O (K log 4 N) , while for any 
given Jf-sparse signal, it can be recovered from only M > 
0(K log N) measurements. In addition, when the filter is 
constructed from the Frank-Zadoff-Chu (FZC) sequence, these 
results also hold for sparse signals in the discrete cosine 
transform (DCT) domain. In many applications, it is highly 
desirable that a data acquisition system can work efficiently 
for both time/spatially sparse signals and spectrally sparse 
ones. For example, in military communications, both time- 
hopping (time-domain sparse) and frequency-hopping signals 
(spectrally sparse) are used to achieve the capability of anti- 
jamming or low probability of intercept. As another example, 
in Radar imaging 11131 . a set of K point targets are spatially 
sparse, while a smooth target is sparse in the Fourier domain. 
Moreover, in astronomical imaging |fl4*l . an image could be 
spatially sparse (with only a few bright objects in a dark 
background) or spectrally sparse as most natural images. Last 
but not the least, in compressive video imaging, each frame can 
be sparsified by the DCT transform. Due to strong temporal 
correlations, the residue images (after motion compensation) 
are spatially sparse. 

The rest of this paper is organized as follows. Section [TT] 
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gives a brief review of CS theory and in particular, random 
convolution-based CS. SectionQll]introduces the framework of 
the proposed system, its potential applications and summarizes 
the main results of this paper. Sections |IV] is devoted to the 
coherence analysis of complex and real-coefficient filters built 
from three classes of deterministic sequences, namely, the 
polyphase sequences, maximum-length sequences and Golay 
complementary sequences. Simulation results are given in [Vl 
followed by conclusions in Section [VI] 

Notation: In this paper, bold letters are used to denote a 
vector or a matrix. For an M x N matrix A, A(p, q) (0 < 
p < M — 1, < q < N — 1) represents the element on its p-th 
row and q-th column. A T and A* denote the transpose and 
Hermitian transpose of A, respectively. For an N x N given 
matrix A, we denote by /i(A) its coherence parameter, i.e., 
the maximum magnitude, 



MA) 



max |A(p, q)\. 

0<p,q<N-l 



For two N x N matrices A and B, their mutual coherence 
/i(A, B) is defined as 

/i(A, B) = /i(AB) = max \A(p, :)B(:, g)|, 

0<p,q<N— 1 

where A(p, :) and B(:, q) correspond to the p-th row of A and 
q-th column of B, respectively. F is the N x N fast Fourier 
transform (FFT) matrix where F(p, q) = e tt~ (0 < p,q < 
N — 1). We use the standard asymptotic notation / (x) = 
0{g{x)) when limsup^^ \f(x)/g(x)\ < oo. 

II. Review of Compressed Sensing 

In this section, we first review uniform and non-uniform 
recovery in compressed sensing, and in particular theoretical 
performance bounds for randomly subsampled unitary matri- 
ces. We then highlight existing works of random convolution- 
based CS. 

A. Uniform vs. Non-Uniform Recovery 

Let © = <fr\E'. Then (fl} can be re-written as 



y = 0f + e. 



(2) 



Hence, reconstruction of x = V&f is equivalent to recovery 
of a iC-sparse vector f. Note that as M < N, eq. (0 is in 
general under-determined. To recover f (or equivalently, x) 
from y, nonlinear optimization is required. In the noiseless 
case (i.e, e = 0), exact recovery can be achieved by a standard 
li minimization program |fT31 



s.t. y = ©f . 



(3) 



In the noisy case, f can be reconstructed using the uncon- 
strained LASSO |[T6l that solves the l\ regularized square 
problem 



min A||f | 



ally 



©fli 



(4) 



where A is the Lagrangian constant. In addition to l\ -based al- 
gorithms, many greedy algorithms, such as orthogonal match- 
ing pursuit [17|, subspace pursuit [18], CoSaMP [19] and their 
variants have been proposed for sparse signal reconstruction. 



These algorithms require lower computational complexity than 
^-based optimization with somewhat weaker theoretical guar- 
antees. 

In CS reconstruction, uniform recovery (2) means that once 
the sampling operator # is constructed, all sparse signals in a 
certain basis can be recovered as long as M is sufficiently 
large. To achieve uniform recovery, many recovery algorithms 
require the restricted isometry property (RIP). 

Definition 1 (RIP): An M x N matrix © = *\1> is said to 
satisfy the RIP with parameters (K, S) (5 e (0, 1)) if 

(1 - <5)||f|| 2 < ||0f|| 2 < (1 + S)\\f || 2 , for all f e T, (5) 

where V represents the set of all i^-sparse vectors of length 
N. 

For RIP constant 6 required in different sparse recovery 
algorithms, please refer to [7 | for details. Note that the RIP is 
a very strong restriction. Among existing sampling operators, 
it is known that the i.i.d. Gaussian and Bernoulli matrices 
satisfy the RIP when M > 0(8~ 2 K log N). However, as we 
have mentioned before, these full random operators are im- 
practical for large-scale CS data acquisition. Another subclass 
of operators satisfying the RIP is randomly sampled unitary 
matrix, as summarized in the following theorem [7|, |20|. 

Theorem 1 (RIP for randomly subsampled unitary matrix): 
Suppose that the M x N matrix © is a randomly subsampled 
unitary matrix, i.e., it can be written as = -^RqU, 
where is a normalizing coefficient, Rq is a random 

sampling operator which selects M samples out of N ones 
uniformly at random, and U is an N x N unitary matrix 
satisfying U*U = ATE at. Then satisfies the RIP with high 
probability provided that Q, ||20l 



M > O (5~ 2 (i 2 (V)K log 4 N) 



(6) 



The above theorem implies that the RIP bound of a ran- 
domly subsampled unitary matrix depends on /x(U). Note 
that for a unitary matrix U with U*U = iVTjv, we have 
1 < /x(U) < ViV. In case when U is chosen as the FFT 
or the Walsh-Hadamard transform (WHT), /i(U) = 1 and by 
Eq. ©, we have 



M > O (<T 2 if log 4 N) 



(7) 



One can also observe that compared with the optimal 
bound provided by fully random matrices, there is an extra 
log 3 N factor in Q. To address this issue, several researchers 
have relaxed the conditions and investigated the case of non- 
uniform recovery, where one just needs to reconstruct a given 
sparse signal. Theorem [2] presents the results for non-uniform 
recovery of a randomly subsmapled unitary matrix using l\- 
based optimization. 

Theorem 2 (Non-uniform recovery): Assume that is a 
randomly subsampled unitary matrix that follows the same 
definition as in Theorem Q] Let f in (ffjl be a fixed arbitrary 
if-sparse signal. Then f can be faithfully recovered from y 
using Zi-based optimization (i.e., © in the noiseless case and 
dUi in the noisy case) if M satisfies ll2D 



M > <D(n 2 (U)KlogN). 



(8) 
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Theorem [2] implies that using randomly subsampled FFT 
or WHT, the number of samples required for non-uniform 
reconstruction is nearly optimal. This is because that non- 
uniform recovery is much weaker than uniform recovery. It 
should also be noted that the above non-uniform recovery only 
holds for l\ optimization. It is still unknown whether we can 
get similar bounds for fast greedy recovery algorithms such 
as subspace pursuit [18| and CoSaMP |fl9l . 

At this point, it is worth pointing out that although partial 
FFT (or WHT) has near-optimal theoretical guarantee, easy 
hardware implementation and fast-computable recovery, its 
major shortcoming is the lack of universality. A universal 
sensing matrix means that it can handle signals that are sparse 
on any <3>. If $ is a Gaussian random matrix, the matrix <&\I/ 
will remain Gaussian for any unitary transform SP. However, if 
<I> is randomly sampled from a FFT, it will not be universal, as 
[i(F*&) can not be 0(1) for all bases \& . As a remedy, in this 
paper, we will propose a new class of randomly subsampled 
circulant matrices that can be used to efficiently sample sparse 
signals in either the time or frequency domain. 

B. Random Convolution for CS 

Tropp et al. |5), Il22ll first proposed the idea of CS using 
convolution with an i.i.d. sequence followed by fixed regular 
sampling. The effectiveness of such an approach has been 
demonstrated through numerical simulations. Later, many peo- 
ple have investigated cyclic convolution with an A-tap random 
filter RJ, J8], (9), in which the sampling operator €> can be 
represented as a partial circulant matrix with the following 
form 



1 



M 



RqA 



(9) 



where A is a circulant matrix that can be expressed as 



a i 



a-N-i 
ao 



at 

«2 
«(} 



(10) 



For $ given in (O, the measurement process can be 
realized by circularly convolving x with a filter a = 
[ao ai ■ • • ctjv-i] and then downsample the output at 
locations indexed by f2. It is also well known that a circulant 
matrix A can be diagonalized using FFT as follows 



A 



1 



(11) 



where £ = diag(er) = diag(o- , a\, • ■ ■ , crjv-i). Eq. (fTTT i 
suggests that a circulant operator is fast computable. It is easy 
to see that the filter vector a (i.e., the first column of A) 
can be obtained by taking the IFFlQ of the diagonal sequence 



0~N-1 



FV. 



(12) 



1 For convenience, the definition here differs from the standard one IFFT = 
r F* by a factor of 1/y/N. 



In other words, a is the normalized FFT of a. It is clear that 
when a is a unimodular sequence, i.e., |f7j,| = 1 (0 < k < 
N — 1), A is a unitary matrix satisfying A* A = ATIjy 

In existing works, the coefficient vector a is constructed 
randomly. In PI. 191. a is a binary random sequence, where 
each eij takes the values of +1 and —1 with equal probability. 
An alternative way is to obtain a from er, which is a binary 
random sequence (5J or a unimodular sequence with random 
phases [8|, i.e., = eJ 6k , where 0^ is a random variable that 
is uniformly distributed in [0, 2ir). 

The sampling operator Rq can be either deterministic or 
random, as summarized below. 

1) Deterministic subsampling: In deterministic sampling, 
f2 is chosen as any arbitrary subset of {1,2, ••■ ,N} with 
cardinality \Q\ = AI. It was shown in J5J that <I> given 
by (|9j satisfies RIP with parameters (K, 8) provided that 
M > O (^(K log N)i^j . More recently, this bound has been 

improved to M > O ((K log 4 A)) j23j. Non-uniform recov- 
ery results have been investigated in [24], where the author 
considered the recovery of a given A'-sparse signal whose 
nonzero components have random signs. Under this model, it 
was established in [23 1 that exact recovery can be achieved 
using li optimization when M > 0(K log N). However, 
unlike Theorem [2] this bound only holds for noiseless mea- 
surement and hence the guarantee for stable recovery under 
noisy measurements is unclear. More importantly, as we will 
show later, when Rji is a deterministic operator, $ given in ([9J 
works poorly for a spectrally sparse signal, which implies that 
it cannot be used directly to sample a natural image (which is 
often sparse in the DCT or the wavelet domain). 

2) Random subsampling: To achieve a universal 
convolution-based CS, Romberg (8) proposed to use a 
random sampling operator Ro- Note that if a is a random 
unimodular sequence, the coherence parameter of A given 
by (fTTT > satisfies 



//(A*) =0( v / ioiiV). 



(13) 



By Theorem Q] such a universal operator satisfies the RIP 
when M > 0{6~ 2 K log 5 N) and by Theorem El M > 
0(5~~ 2 K log 2 N) measurements are required for non-uniform 
recovery. Note that compared with the optimal bounds offered 
by a randomly subsampled unitary matrix, there is an extra 
log A factor in random convolution. It is thus natural to 
ponder: Can we get better bounds for convolution-based CS 
systems with random sampling? 

III. Deterministic filter for convolutional CS 

In this Section, we propose a new framework which answers 
the afore-posed question in the affirmative. 

A. Problem Formulation 

Unlike previous work, we propose the use of a deterministic 
filter followed by random sampling for convolution-based CS. 
Specifically, for <1> given in ©, Rsi is a random sampling 
operator and A is a deterministic circulant matrix. Just as in a 
random filter, there are two ways to construct a deterministic 
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A. In the frequency-domain approach, a is constructed first 
and a is obtained from ( fT2] i. It is clear that A is a unitary 
matrix if and only if a is a unimodular sequence. In the time- 
domain approach, the filter vector a is constructed directly. 
Since it is not easy to get a unitary A using the time- 
domain approach, we will mainly focus on the frequency- 
domain approach, in which a is a unimodular sequence. An 
example of the time-domain construction will be given in 
Section IIV-BI Note that when a is a unimodular sequence, 
A in general is complex valued. Yet real-valued filters are 
desired in many applications, such as Fourier optics and coded 
aperture imaging [12J. To generate real sensing matrices, a 
needs to satisfy the following conjugate symmetry condition 
U: 



defined by 



o"fe = (?N-k> l<k<N — 1, 



(14) 



where the superscript * represents the complex conjugate 
operation. The following theorem presents the requirements 
of a deterministic a under the CS framework: 

Theorem 3: Consider a CS sampling operator $ given 
in ©, where Rq is a random sampling operator and the 
unitary circulant matrix A is generated from ([Til l, with 
cr = [a ,ax, ■ ■ ■ ,crjv-i] T , = 1, k = 0, 1---N - 1 
being a unimodular sequence. If jtx(A) = 0(1), then for all 
i^-sparse signals in the time = In) or spectral domain 
(* = -3=F*), M > 0(K log 4 N) measurements are required 
for uniform recovery; for any given if-sparse signal in the 
time or spectral domain, M > O(KlogN) measurements are 
needed using Zi-based reconstruction. 

Proof: If /i(A) = 0(1), it can be easily derived from 
Theorem [JJ and Theorem [2] that the above statement holds for 
time-domain if-sparse signals (i.e., 'J/ = I at). To see this is the 
case in frequency domain (i.e., \I/ — — L=F*), let us examine 
the coherence parameter /i(A\I/). Note that 



A* 



1 F*£F— Lf* 

N VN 



F*S. 



— I=AF* ) = 1. Therefore, Theorem [3] also holds for 

V AT 



Obviously the square matrix F*E is unitary, and all the entries 
are unimodular, which implies an ideal coherence parameter 

A* 

spectrally sparse signals. 

It is clear that /i(A) = max ( | a-o | , \ai\, ■ • • , |ojv|). By 
(fT2l . the problem now boils down to the construction of a 
unimodular sequence a so that its normalized IFFT coefficients 
are bounded by 0(1). 

B. Main Results 

In this paper, we study the construction of a from a se- 
quence with good autocorrelation property 1251 . Il26ll . Several 
metrics can be defined to measure the goodness of such 
sequences, such as the peak sidelobe level, integrated sidelobe 
level and the merit factor etc. All these metrics can be used 
for both periodic and aperiodic autocorrelations. 

Definition 2 (Periodic and aperiodic autocorrelations): 
For a sequence s of period N, its periodic autocorrelation 
Rs(l) and aperiodic autocorrelation r s (l) are respectively 



R s (l) 



r s (l) 



N-l 

^ s k • s mod (k+l,N) 
k=0 

N-l-1 

k=0 



(15) 



(16) 



where I = 0, 1, 2, • • ■ is an integer. 

Let us first consider sequences with small off-peak periodic 
autocorrelations (or small peak sidelobe level). 

Definition 3 (Perfect and nearly perfect sequences): A se- 
quence s is called a perfect sequence if its periodic autocor- 
relation Rg(l) satisfies 

r, /n f N l = iN 

R ^ = { l^iN. (17) 

A nearly perfect sequence is a sequence with the off-peak 
autocorrelation magnitude bounded by a small value e, i.e., 

|i? s (0l<e, l^iN. (18) 

Due to their wide applications, the construction of (nearly) 
perfect sequences has been extensively studied [25], [26 1 . It is 
well known that perfect polyphase sequences exist for arbitrary 
N l27l . But the only known bipolar perfect sequence (i.e., 
Sk G {1, —1}) is [1, 1, —1, 1]. For nearly-perfect sequences, a 
survey on bipolar and quadriphase sequences is given in l28l . 
A widely used bipolar sequence with e = 1 is the maximum- 
length sequence (also called as the m-sequence), which can 
be easily implemented by shift registers. Other examples of 
bipolar sequences with e = 1 are the Legendre sequences and 
twin-prime sequences. An example of quadriphase sequences 
with e = 1 is the complementary-based sequence. Sequences 
with other values of e such as 2, 3, and 4, can be found in 
11281 . The following Lemma shows that for a nearly perfect 
sequence, p(A) is bounded by yT-Fe. 

Lemma 1 (Bound on the coherence parameter): Let the 
complex- valued matrix A be defined by ( fTTT i where a = s. If 
s is a unimodular perfect sequence, then p(A) = 1. If s is a 
unimodular nearly perfect sequence satisfying ( fT8l ), then 



/Lt(A) < VTT- 



(19) 



Proof: First, we examine the FFT s = Fs of sequence s. 
By the Wiener- Khinchin theorem, the power spectrum |s| 2 is 
given by the FFT of the periodic autocorrelation function R s . 
Thus, we have (for < k < N - 1) 

JV-l 



< 



1=0 



< N- 



N-l 

E 

i=i 



Rs(l)e- 



(20) 



N+(N - l)e. 

Now consider the sequence a = — =F*s. It is easy to show 
that F*s is a reversed version of s (with respect to index 
k), hence the same magnitudes. From ( 1201 ). the coherence 
parameter, i.e., the peak magnitude of a, is bounded by 

M(A) < -l=y/N+(N-l)e < VT+1. 



N 
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When e = 0, it reduces to the ideal bound /tx(A) = 1 for 
perfect sequences. ■ 
Lemma Q] forms the motivation of the method to be devel- 
oped in this paper. It shows that /i(A) will be bounded by 
0(1) if a is a (nearly) perfect sequence. Note that Lemma [T] 
is based on periodic autocorrelation. One may wonder whether 
we have similar results for sequences with good aperiodic 
autocorrelation? It can be shown that R s (l) = r s (l)+r s (N~l). 
Thus, if a sequence has bounded r s (l), R s (l) is also bounded. 
However, the design of s with bounded r s (l) is much more 
difficult. Actually, it is impossible to construct sequences with 
exact impulsive aperiodic autocorrelation (i.e., r s (l) — for 
1 < I < N — 1). Barker sequence has |r s (/)| < 1, but 
it only exists for N < 13. Several variations have been 
considered in literature to construct sequences with good ape- 
riodic autocorrelation, such as zero-correlation zone sequences 
and complementary sequences ll28l . In Section HV-CI we will 
show that a can also be constructed from a complementary 
sequence. 

There are some other limitations of Lemma [TJ Firstly, it is 
difficult, if not impossible to extend to real sensing matrices; 
secondly, the bound in (TT~9b is pessimistic; thirdly, an extension 
to other domains (e.g., DCT) seems difficult. All these issues 
will be addressed in the next section. In a nutshell, Table Q]lists 
the unimodular sequences a used in this paper, along with the 
corresponding N and /x(A). Among them, the FZC is a perfect 
polyphase sequence, the m-sequence is a bipolar sequence 
with e = 1 and the Golay sequence is a complementary 
sequence with good aperiodic autocorrelations. As can be seen, 
for the m-sequence, the bound in Table U is better than y/2 
given by Lemma [T] Table U also suggests that real-coefficient 
A with /i(A) =0(1) can be constructed from the extended 
polyphase or the extended Golay sequences. In addition to 
these results, we will show in Theorem |4] that if a is chosen 
as the FZC sequence, similar bounds hold for sparse signals 
in the DCT domain. Moreover, Theorem shows that if 
A is constructed from the m-sequence using time-domain 
approach, it can be used to sample a zero-mean sparse signal. 

C. Potential Applications 

Note that sequences with good autocorrelations have already 
found wide applications that naturally involve convolution. For 
example, perfect polyphase sequences have been used in Radar 
pulse compression. The maximum-length and complementary 
sequences have been used for channel estimation in commu- 
nications and impulse response (e.g., acoustic or ultrasound 
system) measurement. The fact that these deterministic se- 
quences can be efficiently used in compressive acquisition of 
sparse signals allows for new design considerations. It also 
provides the potential of practical implementation of the CS 
technology with minimum change in hardware or software. 
Here, we discuss two examples of potential applications: 

Fig- QI a ) illustrates the implementation diagram of the 
proposed scheme in channel estimation. Here, we assume 
that the channel response is a time-domain sparse signal with 
K propagation paths. In single-channel estimation, a length- 
N deterministic pilot sequence a is sent directly to probe 



the channel. In an OFDM system, the pilot sequence a is 
transmitted on N subcarriers, which is implemented by an 
Appoint IFFT (time domain sequence a is the output of the 
IFFT). At the receiver, the signal is randomly subsampled 
with M samples and the channel is estimated using sparse 
recovery algorithms. In fact, convolutional-based CS sparse 
channel estimation have been studied in 0], ll29l . 11301 . all of 
which are based on random sequences. As we will show later 
on, by using a deterministic sequence, not only can we get 
better theoretical guarantee, it also leads to simplified radio 
transmitter design in an OFDM system. 

Fig- Q2b) shows another example of the proposed system 
in Fourier Optics or phase coded aperture. The FFT (using 
the first lens) of the signal is modulated with a determin- 
istic diagonal sequence a (implemented via a spatial light 
modulator), fed to IFFT (up to a scaling factor N~ x / 2 ) by 
the second lens, then randomly subsampled. It is similar to 
the imaging architecture in 1 8 ] but with fixed coefficients of 
a. Simulation results show that our proposed scheme can 
effectively reconstruct natural images. On the other hand, if 
we use a random sequence a and sampled deterministically, 
one can only recover a spatially sparse signal. 

Other potential applications of the proposed system include 
Radar imaging, compressive spectrum measurement and mag- 
netic resonant imaging etc. 

D. Connections With Existing Work 

The comparison between the proposed scheme and existing 
random convolution-based operators is shown in Table [TTJ It 
can be seen that the proposed scheme offers near optimal 
theoretical performance guarantee for both uniform and non- 
uniform CS recovery, thanks to its deterministic construction 
of a. Recall that for a random filter, the coherence parameter is 
bounded by 0(^/TogN) J8), J9). The 0(1) coherence param- 
eter associated with deterministic a enables us to remove the 
extra (log N) factor in existing random convolution. Although 
the proposed scheme can not offer universality, it works for 
both time and frequency domains (and the DCT domain for 
FZC sequences). Thus, the proposed scheme can be used 
as a hardware-friendly, memory-efficient and fast computable 
solution for large scale CS applications, e.g., hyperspectral 
imaging. During the revision of this paper, we learnt of the 
work l23l which presented the same bounds for the partial 
circulant operator; however, the bounds in ll23l hold in the 
time domain only. 

It should be mentioned that deterministic sequences have 
been investigated in CS before. For example, chirp sequences 
were applied to radio interferometry in [31], where the sensing 
matrix was constructed in a different way, namely, it was the 
product of a rectangular binary matrix M, Fourier matrix 
F, diagonal matrix C implementing chirp modulation and 
diagonal matrix D implementing the primary beam. The 
coherence was analyzed when St is formed by Gaussian wave- 
forms. Chirp sequences were also used to construct determin- 
istic sensing matrices in |32| . which cannot be implemented 
through convolution. Besides, the sizes of the sampling oper- 
ators in 1321 are restricted to be M x M 2 . Upon completion 
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TABLE I 

Coherence parameter /u(A) for different diagonal sequences a 





(7 


N 


MA) 


Complex matrices 


FZC 


Arbitrary 


1 


m-sequence 


2 fc - 1, k 6 N 


vA + lv" 


Golay sequence 


2 k1 10 K2 26 k '\ki,K2,K3 e N 


\/2 


Real matrices 


Extended polyphase 


Even N 




Odd JV 


2.69 + 


Extended Golay 


Even N, N = 2 K i 10 K2 26 K3 , «i , k 2 , «3 £ N 




Odd N, N = 2 K ilO K 2 26 K 3 ± 1, rei, /t 2 , «3 6 N 


2 + vw 











"i 




IFFT 




P/S 




a N-l 











Single channel estimation 



channel 



Random 
Sampling 



Sparse 
recovery 




OFDM channel estimation 

(a) 

A 





f 

lens fixed phase lens random sampling sensor array 



(b) 

Fig. 1, Applications of convolutional compressed sensing, (a) Channel estimation; (b) Coded aperture imaging or Fourier optics. The lenses transform the 
signal to Fourier domain and back. 



TABLE II 

Comparison of Different Circulant Operators for Compressed Sensing 



Measurement Operator # 


Random Convolution | 8 | 


Partial Circulant Operator |9|, |23| 


This Work 


Filter Coefficients 


Random 


Random 


Deterministic 


Sub-sampling Operator 


Random 


Deterministic 


Random 


Sparsifying Transform *T/ 


Arbitrary 


I 


I or IFFT 


Restricted Isometry Property 


M > 0(K log 5 AT) 


M > e>(Xlog 4 A0 


M > OiK log 4 A^) 


Non-Uniform Recovery 


M > 0(K log N) 


M > 0{K log N) 


M > 0(K log N) 



of this work, we learned that perfect sequences (including 
the FZC sequence and real-valued perfect tenary sequences) 
were used as the entries of Toeplitz sensing matrices in radio 
spectrum estimation l33l . Yet the analysis of the coherence 
parameter or RIP was limited to the cases = In and 
\|j = -^7=F in [33). Taking a step forward, our results hold for 
both nearly perfect sequences and complementary sequences. 
For the particular case of the FZC sequence, we have also 
generalized the result for the DCT basis. Besides, we have 
also presented the design of real-valued sensing matrices in 
Section V with arbitrary length N. 



IV. Coherence Analysis 

The previous section derives the restriction of a under the 
CS framework. From a practical perspective, there are other 
restrictions. For example, in Radar, a^. needs to have a constant 
magnitude. In coded aperture imaging, ak is real-valued. Also, 
in OFDM channel estimation, it is desirable that the sequence 
can minimize the peak power required for signal transmission. 
It is also preferable that the sequence length is N — 2 k for fast 
FFT implementation. Some other desirable properties include 

m 

• a or a exists for flexible length N; 

• <Jk or ak takes a minimum number of values; 

• <Tk or afc takes values on a pre-determined signalling set 
(e.g., BPSK or QPSK); 
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• a or a can be easily generated. 
However, none of the existing sequences can satisfy all above 
mentioned requirements. For instance, the widely used bipolar 
m-sequence has low implementation complexity and good au- 
tocorrelation property. However, it only exists for N = 2 k — 1 
(k E N). Perfect polyphase (chirp) sequences exist for arbitrary 
length N, but they are difficult to generate. Besides, they 
are not on the popular constellation sets such as BPSK or 
QPSK. Taking these facts into account, we carry out a case-by- 
case coherence analysis of circulant matrices constructed from 
three classes of sequences: (/) the polyphase sequence, (ii) m- 
sequence and (Hi) complementary sequence. Our analysis will 
be conducted for both complex and real-valued matrices A. 

A. Polyphase Sequences 

As shown in Lemma Q] when a is a unimodular perfect 
sequence, we have \dk\ — 1, i.e., A has the ideal coherence 
parameter /x(A) = 1, Such a perfect sequence is said to satisfy 
the constant amplitude and zero autocorrelation (CAZAC) 
property. This property is very crucial to applications such 
as Radar. Here, we study a well known CAZAC sequence, the 
FZC sequence, that has been used in phase coded Radar and 
3GPP Long Term Evolution (LTE). The 7-th sequence (7 is 
an integer that is coprime with N) within the FZC family is 
given by [35 @ 



Sfc 



for even N; 
for odd N, 



(21) 



for k = 0, 1, • • • , N — 1. In fact, we can set either the filter 
vector a or its FFT coefficient a as the FZC sequence. This is 
because the Fourier transform of an FZC sequence is another 
FZC sequence ||35l , implying both the time and frequency- 
domain approach apply. Under these constructions, A is 
an unitary circulant matrix with ideal coherence parameter 
/i(A) = 1. The next Theorem further shows that matrix A 
generated from the FZC sequence can also be used to sample 
a sparse signals in the DCT domain. 

Theorem 4: Let IDCT represent the inverse Type-II DCT 
matrix, and let A be a unitary circulant matrix generated from 
(fTTl i. in which a is an FZC sequence with 7 = 1. The matrix 

U = A IDCT = A~ 1/2 F* SF . IDCT (22) 

has coherence parameter /i(U) < 

The proof of this Theorem relies on the results of partial 
Gauss sum (summarized in Appendix A) and details will be 
given in Appendix B. It suggests that an FZC -based operator 
can be applied in compressive imaging as the Type-II DCT is 
widely used in image/video compression standards to sparsify 
the signals. It should also be pointed out that although we 
could only derive the bound for 7 = 1 in Theorem [4] our 
simulations indicate that the result may hold for arbitrary 
7. Moreover, A constructed from the FZC appears to be 
incoherent with other bases, such as the wavelet and the 
modified DCT. How to generalize the above result for different 

2 This definition gives a sequence which is the complex conjugate of the 
standard one [36]. They obviously have the same autocorrelation magnitudes. 



7 and different \fr is an interesting problem that is worth further 
study. 

Next, we will investigate how to generate real-coefficient 
a from a polyphase sequence a. Here, a needs to satisfy the 
conjugate symmetry property in ( fl4b . We define an polyphase 
sequence that resembles the FZC sequence. Specifically, when 
N is an even number, a is given by 



1 
1 



1 



k = 
1 <k< f 
k — ~2 

f + l<fc<iV-l; 



(23) 



when N is an odd number, a can be expressed as 

1 k = 

rr, = < e~ j Ti k2 1 < k < 



N-l 

E±l <k <N- 



(24) 



1. 




Unlike the FZC sequence, it is not straightforward to derive 
the close-form expression of when u is given in (f23b or 
( l24l ) . Fortunately, by exploiting partial Gauss sum, we can still 
show that cifc is bounded by 0(1), as stated in the following 
Lemma: 

Lemma 2: Let a be defined as ( l23b or d24"i i. for even and 
odd N, respectively. Then the coherence parameter satisfies 



(25) 



The proof can be found in Appendix C. Note that the main 
advantage of using ( f23l and (124-b is that they exist for arbitrary 
N. Besides, quadratic phase modulation has been proved as 
an effective method to improve spatial resolution in magnetic 
resonance imaging [37]. The above lemma implies that in 
these systems, we can further speed up imaging process by 
exploiting the CS theory. 

B. Maximum-Length Sequences 

Although perfect polyphase sequences exist for arbitrary 
N, in some applications, it is more desirable to use bipolar 
sequences for due to their easy implementation. A popular 
bipolar sequence is the m-sequence whose autocorrelation is 
given by 11381 



N, 1 = mod N; 
— 1, otherwise. 



(26) 



Accordingly, from the Wiener-Khinchin relation we have 



a k = 



L 



k = 0; 



\/N + 1, otherwise. 



(27) 



Therefore, if a is chosen as the m-sequence, A is complex 
valued with coherence parameter 



(i m (A) = y/(N + l)/N. 



(28) 



Unlike the FZC sequence, using frequency-domain ap- 
proach, we cannot easily get a real-coefficient matrix A with 
/i(A) < 0(1) by extending the m-sequence. Nonetheless, the 
time-domain approach can be used here. If we set a directly 
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as an m-sequence, the following theorem implies that it can 
be used to sample a zero-mean sparse signal: 

Theorem 5: Consider an M x TV ( TV = 2 k — 1) CS sampling 
operator given in d9ll-([T0i>. in which a is an m-sequence. Then, 
for all zero-mean iV-sparse signals in the time = Ijy) or 
spectral domain = — LF^r), M > 0{K\og A TV) measure- 
ments are required for uniform recovery; for any given K- 
sparse signal in the time or spectral domain, M > 0(K log TV) 
measurements are needed using ?j -based reconstruction. 

Proof: It is known that a real-coefficient binary perfect 
sequence a can be obtained from an m-sequence a as follows 
El 



N 



N + l 



1 



v/FTT 



l-N, 



(29) 



in which ljy represents an TV x 1 all-ones vector. As a. is a 
perfect sequence, using a similar argument to Lemma Q] we 
know that a = -^=Fa is a unimodular sequence. Hence, the 

corresponding circulant matrix A = J -jM-^ A+ ( 1 j= 



ones(TV, TV) is orthogonal with /i(A) < 2. Thus, according 
to Theorem [3] A can be used for TV-sparse signals in the 
time or spectral domain, in which M > 0(K log 4 TV) and 
M > 0(K log TV) measurements are required for uniform and 
non-uniform sparse recovery, respectively. Note that for a zero 
mean signal x (i.e., J2 x i = 0) Ax = \J ivqrr-A-X. Hence, 
measurement usi ng A is equivalent to that of A except for a 
scaling factor yj TvTT- As a result, Theorem [3] holds. ■ 

Note that zero mean is a very mild restriction. Also, the DC 
component of a signal can be easily measured, implying the 
proposed scheme is applicable to nonzero-mean signals. 

The m-sequence has found applications in measurement 
of impulse response, channel estimation, spread spectrum 
communications and fMRI. In the classical method of impulse 
response measurement, the measured data need to be sampled 
at a full rate and reconstructed using the correlation method. 
If the impulse response (or its transfer function) is sparse, 
the above theorem suggests that it can be reconstructed from 
a small random subset of measurements. In other words, 
in case when there is impulsive noise or erasure errors, 
sparse reconstruction can provide robust recovery. It should be 
pointed out that due to the close connection between the m- 
sequence and Walsh-Hadamard operator [39|, multiplication 
of A can be easily implemented using 0(N log N) additions. 

Remark 1: Other (nearly) perfect sequences, for example, 
the tenary perfect sequences (33], ll40l and the Legendre 
sequence |28| (with e = 1), could also be used to construct 
an orthogonal A using time domain approach. Yet, they are 
not as widely used as the m-sequence. Besides, the lengths 
of these sequences are not quite flexible. For a tenary perfect 
sequence, TV = p p3 , in which p is an odd prime, k and s 
are integers. The Legendre sequence only exists for odd prime 

n m. 

C. Golay Sequences 

Note that the m-sequence only exists for TV — 2 k — 1. As 
mentioned before, in many applications, such as OFDM, it is 



desired to have TV = 2 k . In this subsection, we consider binary 
complementary sequences (also known as Golay sequences) 
introduced by Golay in 1961 [42|. These sequences have good 
aperiodic autocorrelation and they have found numerous appli- 
cations in spectroscopy, ultrasound and acoustic measurement, 
Radar pulse compression, WI-FI networks, OFDM and non- 
destructive test etc. 03], EH - 

Definition 4 (Golay sequences): Let a = 

(ao,ai,-" ,ajv-i) and b = (bo,bi,--- ,6/v-i) be a 
pair of binary sequences with values 1 or — 1. Then a and b 
form a Golay complementary pair if 



r«(0 + n>(0 



27V, 1 = 
0, 1 = 1, 



,N-1. 



(30) 



A sequence in any complementary pair is called a Golay 
sequence. 

Let S a (u>) = E^oVe^™ and S b (ui) = b k e>" n 
represent the discrete time Fourier transform of a and b, 
respectively. Then, the following relation holds 



|SaM| 2 + |SbM| 2 = 2iV. 



(31) 



Note that for any length- N Golay sequence s, it simply follows 
from ( f3~Tb that IS's (oj) | 2 < 27V. Based on this property, we can 
easily arrive at the following corollary: 

Corollary 1: Let the diagonal sequence a be a Golay se- 
quence s of length TV. Then, A is a unitary circulant matrix 
with n(A) < 

As mentioned previously, one promising application of 
convolutional CS is in OFDM channel estimation. One of the 
main practical issues of the OFDM is the Peak-to-Average 
Power Ratio (PAPR) of the transmitted signal, which can 
significantly impact the efficiency of the power amplifier. 
Specifically, for a length-TV sequence a, its PAPR is given 

by ma 



PAPR(cr) = max 

te[o,T) 



N-l 
— 2_ Vn.e 1 

n=0 



where T is the OFDM symbol period. For a Golay sequence, 
it is obvious that its PAPR is bounded by 2. In contrast, if 
a is a random sequence, its PAPR is asymptotically log TV 
with probability 1 fl45ll . From this point of view, Golay 
sequences are more advantageous for compressive OFDM 
channel estimation than random sequences. 

We then move on to consider real sensing matrices con- 
structed from an extended Golay sequence. 

Theorem 6 (//(A) for extended Golay sequence): Let s be 
a Golay sequence with length of Nq. When TV = 2TVo, a is 
define by 



When TV = 2TV 



0-fc 




0< k < f 
k — — , 

N 



1, 



f + l<fc<TV-l; 



1, a is defined by 

0<fc< E=l 



SN-k 



1, 



N+l 



< k < TV - 1: 



(32) 



(33) 
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Then /i(A) is bounded by 

MA)< 



TABLE IV 

ClRCULANT MATRICES USED IN EXPERIMENT 2 



2 +v%' Nevea ' 
2 + ^, iVodd. 



(34) 



Proof: We show the proof for even N, while the case of 
odd N is omitted since it is very similar. Note that 



it (A) = ■ max 

VN a<k<N 



<- 



max 

N 0<k<N 



j - ^ 



max 

o<k<N 



N-l 
i=0 

2irk 

~w 

2nk 



hi 



s s 



2TTk\ 



S s 



s e j « k - s 



(35) 



in which S s (u) is the discrete-time Fourier transform of s, i.e. 
S s (ui) = J2k=o 1 s k^ uk ■ By definition of the Golay comple 
mentary sequence, |5 s (w)| < \/2Nq = 

2 



N. Consequently, 

At (A) < 2 + ^= for N = 2N . ■ 
The above result indicates that the extended Golay sequence 
is quite attractive in phase coded aperture imaging. As <jk 
is bipolar, it can be easily implemented using a spatial light 
modulator. Besides, Golay sequences are known to exist for all 
lengths 2 Kl 10 K2 26 K3 , Ki, K2, which offers great flexibility 
in image sizes. 

Remark 2 (Golay-OSTM): The authors introduced orthog- 
onal symmetric Toeplitz matrices (OSTM) as sensing ma- 
trices in 1 46 1, and proposed to use the Golay sequence as 
the diagonal sequence in l47l . In general, OSTM may be 
viewed as a special case of convolutional CS, where the 
sequence s g {-1, l} N / 2 \{(-l, -1, ■ • • , -1), (1, 1, • • • , 1)}. 
The symmetry of OSTM, i.e., A(i,j) — A(j,i) — ffli»-ji, 
could can be exploited for fast reconstruction. 

V. Simulation Results 

In this section, we present the simulation results for the 
following two experiments: 

Experiment 1: In this experiment, we aim to study the 
potential of the proposed system in OFDM channel estimation. 
Here, the number of carrier is N = 1024 and M = 64 
samples are obtained at the receiver, a is set to be the Golay 
sequence due to its excellent PAPR. The channel model is 
the ATTC (Advanced Television Technology Center) and the 
Grande Alliance DTV laboratorys ensemble E model, whose 
static case impulse response x(n) can be expressed as l48l 

x(n) =S(n) + 0.3162<5(n - 2) + 0.1995<5(n - 17) 

+ 0.1296<5(n - 36) + 0.1<S(n - 75) + 0.15(n - 137); 

(36) 

We consider the cases when the signal to noise ratios (SNRs) 
are dB, 10 dB, 20 dB and 30 dB, respectively. For each SNR, 
500 trials have run using the subspace pursuit |18] algorithm. 
The recovery performance is compared with that proposed in 
1 30 1, in which a is a unimodular sequence with random phase 
and Rji is a deterministic sampling operator. From Table Hill 
it can be seen that both schemes offer similar reconstruction 



Schemes 


(7 


Rf2 


RP+DS 


Random phase 


Deterministic 


RP+RS 


Random phase 


Random 


E-Poly+RS 


Extended polyphase sequence 


Random 


E-Golay+RS 


Extended Golay sequence 


Random 



performance. Yet, with the Golay sequence, the PAPR is much 
lower than that of random sequence. 

Experiment 2: Here, we study the application of compres- 
sive imaging of 2D signals using coded aperture imaging or 
Fourier optics. In these applications, a& (k = 0, • • • , N — 1) 
need to be real-coefficient. Hence, the extended polyphase se- 
quence and the extended Golay sequence are considered. They 
are compared with that of unimodular random phase sequences 
with random and deterministic sampling, as listed Table [TV] 
The fast reconstruction algorithm for Toeplitz matrices in ifTTTl 
is applied. Three 8-bit, 256 x 256 test images have been 
used, as shown in Fig. [2] In particular, Fig. |2a) "Star-sky" 
is a spatially sparse astronomical image, Fig. |2f) "Tempel 
Comet" is a smooth astronomical image, and Fig.|2jk) "Brain" 
is a medical image. The recovered images at R = 0.25 bits 
per pixel (bpp) are shown in Fig. [2] and the reconstructed 
SNRs at different bit rates are presented in Fig. [3] As can be 
seen, when deterministic sampling is used, the reconstructed 
SNRs are much lower than those using random sampling. For 
a spatially sparse image "Star Sky", the visual difference is 
small. But for the other two spectrally sparse images, the 
scheme using random sequence with deterministic sampling 
failed to recover the original image. These results suggested 
that partial random circulant matrices with deterministic sam- 
pling are not efficient in acquisition of natural images. In 
contrast, the proposed schemes with deterministic sequences 
can offer similar performance as those of random sequences 
with random sampling, both in terms of the SNRs and the 
visual quality of reconstructed images. 



VI. Conclusions 

In this paper, we have proposed a new class of circulant 
sensing matrices, which were constructed from deterministic 
sequences with good autocorrelation property, such as the FZC 
sequence and Golay sequence. We showed that these convolu- 
tional sensing matrices have a small coherence parameter with 
the time and spectral domain, so that the original sparse signal 
could be faithfully recovered. The proved theoretic guarantee 
is the strongest among existing convolution-based CS schemes. 
Experimental results show that these sensing matrices compare 
favorably with existing structured random matrices. Since the 
underlying deterministic sequences are widely used in practice, 
a major advantage of the proposed scheme is that it may be 
integrated into existing systems. Namely, when part of the data 
is corrupted such that traditional techniques fail to recover 
the original signal, our analysis shows that the CS recovery 
algorithms will be helpful. It is hoped that this work will open 
the door to more applications of sequences in CS. 
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TABLE III 

Average Output SNRs in OFDM channel estimation 





Partial Circulant Operator 


Proposed System 


a 


Random Phase 


Golay 




Deterministic 


Random Sampling 


PAPR 


[6.4, 15.6] 


2 


Input SNR 


dB 


5.32 dB 


5.44 dB 


10 dB 


13.98 dB 


14.34 dB 


20 dB 


37.53 dB 


37.48 dB 


30 dB 


45.22 dB 


45.61 dB 




Fig. 2. Original 256 X 256 images and reconstructed results at 0.25bpp using different real-coefficient images. First row, "Star-sky" images, (a) Original 
image; (b) RP+DS: 17.85 dB; (c) RP+RS: 24.02 dB; (d) E-Poly+RS: 24.10 dB; (e) E-Golay+RS: 24.11 dB. Second row, "Tempel Comet" images, (f) Original 
image; (g) RP+DS: 0.37 dB; (h) RP+RS: 30.16 dB; (i) E-Poly+RS: 29.88 dB; (j) E-Golay+RS: 30.26 dB. Third row, "Brain" images, (k) Original image; (1) 
RP+DS: 1.00 dB; (m) RP+RS: 20.93 dB; (n) E-Poly+RS: 20.94 dB; (o) E-Poly+RS: 20.98 dB. Please refer to Table||V]for acronyms of different schemes. 



Appendix A 
Partial Gauss Sums 

Definition 5: Let TV be a positive integer. The exponential 
sum (49) 

m— 1 

G N (m) = e^ fe2/JV (37) 

fc=0 

is an incomplete Gauss sum when m < N. 

When m — N, the complete Gauss sum Gn(N) is well 
known |49| 



G N (N) 



(1+.?) 


VN, if 


7V = 





(mod 4) 


y/N, 


if 


7Y = 


1 


(mod 4) 


0, 


if 


7Y = 


2 


(mod 4) 


jVN, 


if 


7Y = 


3 


(mod 4) 



(38) 



Moreover, when m < (N + l)/2, 

G N {m) + G N (N -m+1) = 1 + G N (N). (39) 
Define a normalized version gijv(m) as 

g N (m) = 2N-iJ2^ k2/N ^ 



(40) 



k=0 



then we have [49 1 



where k is a positive integer. 



if N = 4k, m < N/2 
1.07 + 0(7^-3), if N = 4k + 1, m < N/2 
0.95+ ^-N-i, if N = 4k + 2,m<N 
yT+TF 1 , if N = 4k + 3,m < N/2, 

(41) 
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Based on the above results, we can easily arrive at the The last step is due to (l42b . When 1 < q < N — 1 and 
following Lemma: < p < N — 1, 

Lemma 3: Define G 2 n{tti) as 

U fe9) = E A(p,fc)cos + i)g) • ^ 

fc=0 v 7 v 

V2 



G 2N (m) = E 



2iV 



E 



Then, G 2 n{itl) can be bounded 



2VN 



^2 e ^ {p ~ k)2 -^ (e- j T? {k+ ^- )q + e j ^ (k+h - )q 

(46) 



fc=0 



A, 



|G 2 jv(m)| < { 3VF+1, 



if iV — 2iVo, m f£hr£>ugh some mathematical manipulations, it can be shown 
if N = 2N , N *at<J^B,<$)2c¥n-b4 bounded by 

if N = 2N + 1, m < 2N, 



(42) ' u <">'^( 



Appendix B 
Proof of Theorem 4 



< 



JV-l 

E 

k=0 
N-l 

E e 3 '^ 1 

fc=0 



e J#(fe-p-5 < ?)' 



JV-l 

E 

fc=0 



(47) 



Proof: For clarity we only give the proof for even iV 
here. The case of odd N is similar and is omitted. We apply 
a result from [35] that the Fourier dual of a unimodular 
perfect sequence yields another unimodular perfect sequence. 
Specifically, when a is an FZC sequence in d2~Tl i with 7 = 1, 
the elements of A are given by 11351 



When q = 2go is an even number, let p + go = ',0 < I < 
^-1, we have e^( fc - p -5«) 2 = e 3 '*^- 4 ) 2 . If < I < JV-l, 



AT-l 

E< 

k=0 



\G 2N (l + 1) + G 2 n{N — — 1| < 2VA+1 

(48) 



A(p, g) 



jTr(p-q) _ in 



where the last step is due to partial Gaussian Sum. If N < 



Obviously, we may ignore the phase e~~ when calculating 
its magnitude. Note that the IDCT coefficients are can be 
expressed as 



JV-1 
fc=0 



< \G 2N (2N + G 2N (l - N + 1) - 1| < 2VN+1 

(49) 



nXT(p,g) = 



i 



'fcos(f (p + £)g), l<g<A-l 
Thus, when g = and < p < N — 1, 
1 



|U(p,0)l = 



JV-l 



-(p-fe)" 



g = where again the property |G2jv(0l — v-^ f° r ' — N is 
applied. So for even g, we have |U(p, g)| < 2\/2 + -^=. When 
g = 2go + 1 is an odd number, let I = p + go. After some 
tedious calculations, we may break up (|4"7T i into 

V2 



1 



(45) 



\G 2N {N)\ < 1. 



|U(p,g)| < (\Q N (mod(l,N) + 1)| 

zv A 

+ |Q JV (JV-l-mod(I,J\0)| 

+ |Qw(b-go|)|+ |Qjv(A- \p-q \ 



(50) 
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where Qn(iti) is given by 

m—X m—1 

Q N (m) = e J ^ (fc+ ^ )2 = e J ^ (2fc+1)2 ,0 < m < N 

k=0 k=0 

(51) 

It can be shown that Qat(to) = GsAr(2m) — GW( m )> which 
leads to 

|<9iv(m)| < \G 8N (2m)\ + \G 2N (m)\ = 3ViV (52) 

for < to < N. As a result, \U(p,q)\ < 6%/2 for odd q. 
Combined with the result for even q, we arrive at Theorem [4] 

■ 

Appendix C 
Proof of Lemma [2] 

Proof: The proof is also based on the incomplete Gauss 
sum in Appendix A. Again, for simplicity, we only present 
the proof for even N. 

As <7]v-/c = 0fe, 1 < k < — 1. it can be shown that ai 
takes the following form 

N/2-1 

ai = _L y e ^(-fe 2 w 2 ). e ^ 2 

1 ^Z 2 " 1 1 c 

. f\f ^—^ ./~xf ./~xf 



fc=0 

Thus, we have 



hi < 



N/2-1 

£ • 

k=0 



N 



0<1<N-1. (53) 



When < I < f - 1, 



v G 2 jv(Z + l) + G 2 iv( -1 
2 / /re \ 2 4 

< — (2^+1 + — < 4 + — . 
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In a similar way, it can be shown that | ajy_ i | for < I < — 1 
can be bounded by 
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(55) 



which completes the proof. 
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